3 



E!D 317 187 IR 014 272 

AUTHOR Levine, John H.; Schneider, Walter 

TITLE Feedlsack Effects in Computer-Based Skill Learning. 

Final Report. 

INSTITUTION Pittsburgh Univ., Pa. Learning Research and 

Development Center. 
SPONS AGENCY Office of Naval Research, Arlington, Va. 
PUB DATE Sep 89 

CONTRACT N00014-86-K-0569 
NOTE 76p. 

PUB TYPE Reports - Research/Technical (143) 

EDRS PRICE KF01/PC04 Plus Postage. 

DESCRIPTORS ^Cognitive Processes; ^Computer Assisted Instruction; 

*Feedbac]c; Higher Education; * Instructional Design; 
Undergraduate Students 

ABSTRACT 

This paper reports several experiments that 
Investigated how performance feedback in a computer-based training 
environment affected students' acquisition of cognitive skills 
requiring substantial practice. College students worked on 
category-search or electronic troubleshooting tasks. Problems were 
presented, responses were recorded, and performance feedback was 
given using microcomputers. The studies exaunlned the impact of 
receiving information about (1) temporal trends in one's own 
performance (i.e., intrapersonal feedback alone), and (2) temporal 
trends in both one's own and others' performance (i.e., joint 
intrapersonal and interpersonal feedback) . In regard to intrapersonal 
feedback alone, the effects on students* learning of different types 
of "absolute" performance information (e.g., weighted versus 
unweighted averages of reaction times on previous trials) were 
assessed. Results indicated theit these manipulations had only weak 
effects. In regard to joint Intrapersonal and Interpersonal feedback, 
the effects on students' learning of different types of "relative" 
performance information (superiority versus inferiority as compared 
to others) were assessed. Here, evidence revealed that the type of 
feedback students received influenced how well they performed. It is 
suggested that the impact of intrapersonal and interpersonal feedback 
will bo affected by the amount of practice time needed to achieve 
proficiency, and that feedback may have a larger effect with extended 
training periods representative of normal classroom instruction. Data 
are presented in both tabular and graphical form. (65 references) 
(Author/QL) 



************************************************************* i*isisn*itit* 

* Reproductions supplied by EDRS ore the best that can be made * 

* from the original document. * 

lilt *iiitiiititit*ii***************it*it***i( ************** *********** 



p. 

Pi 



OfT«# of Edue«t)pn«i Rtitarch and improvtmem 

FOUCATIONAl RESgURCES INFORMATION 
J CENTER (ERIC) 

y^This document has been reprcxjuced aa 
received from the person or organi£a(ior) 
oriQiruting it 

n Mirtor changea have been mad» to improve 

reproduction quanty 

Potma of view or opmioni staled m this docu- 
ment do not necessarily represent official 
OERI position or policy 




Feedback Effects in Computer-Based 
Skill Learning 



John M. Levine and Walter Schneider 
Learning Research and Development Center 
University of Pittsburgh 
Pittsburgh. PA 15260 



II 



1 



Feedback Effects in Computer-Based 
Skill Learning 



John M. Levine and Walter Schneider 
Learning Research and Development Center 
University of Pittsburgh 
Pittsburgh, PA 15260 



September 1989 
Final Report 



This research wassponsored by the Cognitive Science Program, Office of Navai Research, under Contract 
No. N00014-86-K-0S69, Contract Authority Identification Number. NR 442C021. 

Reproduction in whole or part is permitted for any purpose of the United States Government. 

Approved for public release; distribution unlimited. 



Ste^Ut^ltV dAislt=ICATl6N 01^ THIS tiAGF 



REPORT DOCUMENTATION PAGE 



Form Approved 
0MB No. 0704 0188 



U..REPORT SECURITY CLASSIFICATION 

Unclassified 



lb. RESTRICTIVE MARKINGS 

None 



2», SECURITY CIASSIFICATION AUTHORITY 

2b. DECLASSIFICATION /DOWNGRADING SCHEDULE 



3. DISTRIBUTION /AVAILABILITY OF REPORT 

Approved for public release; 
distribution \mllmited 



4. PERFORMING ORGANIZATION REPORT NUMBER(S) 



S. MONITORING ORGANIZATION REPORT NUMBER(S) 



6a. NAME OF PERFORMING ORGANIZATION 

Learning Research & Development 
Center » University of Plttsburgl 



6b. OFFICE SYMBOL 
(If applicable) 



7a. NAME OF MONITORING ORGANIZATION 

Cognitive Science Program 

Office of Naval Research (Code 1142C5) 



6c ADDRESS (City. State, and HP Code) 
Pittsburgh, PA 15260 



7b. ADDRESS (Gty, State, and ZIP Code) 
800 North Qulncy Street 
Arlington, VA 22217-5000 



8a. NAME OF FUNDING /SPONSORING 
ORGANIZATION 



8b. OFFICE SYMBOL 
(If appliu^ble) 



9. PROCUREMENT INSTRUMENT IDENTIFICATION NUMBER 

N00014-86-.K-0569 



8c. ADDRESS (City, State, and HP Code) 



10 SOURCE OF FUNDING NUMBERS 



PROGRAM 
ELEMENT NO. 

61153N 



PROJECT 
NO. 

RR04206 



TASK 

NO. 

1U104206-OC 



WORK UNIT 
ACCESSION NO. 

4A2C021 



11. TITLE (Include Security Classification) 

Feedback Effects in Computer-Based Skill Learning 



12. PERS«^NAL AUTHOR(S> 

Jot.n M« Levine and Walter Schneider 



13a. TYI E OF REPORT 
Pinal 



13b. TIME COVERED 

FRO.vi 1986 TO 1989 



14. DATE OF REPORT {Year, Month, Day) 

1989, September, 12 



IS. PAGE COUNT 

66 



16. SUPPLEMENTARY NOTATION 



17. 



COSATI CODES 



FIELD 


GROUP 


SUB-GROUP 


05 


08 











18. SUBJECT TERMS {Continue on reverse if necessary and identify by block number) 

performance feedback, motivation, computer-based 
learning, skill acquisition, automatlclty 



19 ABSTRACT {Continue on reverse if necessary and identify by block number) 

This paper reports several experiments that Investigated how performance feedback 
in a computer--based training environment affected students^ acquisition of cognitive 
skills requiring substantial practice. College students worked on category-search 
or electronic troubleshooting tasks; problems were presented, responses were recorded, 
and performance feedback was given using microcomputers « We studied the Impact of 
receiving information about (a) temporal trends in one's own performance (i.e., 
intrapersonal feedback alone) and (b) temporal trends in both one's own and others' 
performance (i«er, joint intrapersonal and Interpersonal feedback) « In regard to 
intrapersonal feedback alone, we assessed how different types of "absolute" 
performance information (e.g., weighted vs. unweighted averages of reaction times on 
previous trials) affected students' learning. Results indicated that these 
manipulations had only weak effects. In regard to joint Intrapersonal and interpersonal 



20. OlSTmBUTION /AVAILABILITY OF ABSTRACT 

® UNCLASSIFIED/UNLIMITED □ SAME AS RPT □ OTIC USERS 


21, ABSTRACT SECURITY CLASSIFICATION 

Unclassified 


22a. NAME OF RESPONSIBLE INDIVIDUAL 

Dr. Susan Chlpman 


22b. TELEPHONE (Include Area Code) 
202-696-4318 


22c OFFICE SYMBOL 

ONR 1142CS 



OO Form1473« JUN 86 



Previous editions are obsolete. 
S/N 0102-LF-01A-6603 



SECURITY CLASSIFICATI ON OF THIS PAGE 



• Unclassified 

; SECURITY CLASSIFICATION OF THIS PAOr 

.^^^^^^ 19, Abstract (continued) 
_ pjv feedback, we assessed how different types of "relative" performance Information 
(e.g., superiority vs. Inferiority vls-a-vls others) affected students* learning. 
Here, evidence revealed that the type of feedback students received Influenced 
how well they performed. It was suggested that the impact of intrapersonal and 
Interpersonal feedback will be affected by the amount of practice time needed to 
achieve proficiency. Feedback may have a larger effect with extended training 
periods representative of normal classroom instruction. 




00 Form 1473, JUN 86 (Reverse) security classification of this page 



Abstract 

This paper reports several experiments that investigated how performance feedbacl< 
in a computer-based training environment affected students' acquisition of cognitive si<iiis 
requiring substantial practice. Coiiege students worked on category-search or electronic 
troubleshooting tasks; problems were presented, responses were recorded, and 
perf ormancef eedback was given using microcomputers. We studied the impact of receiving 
information about (a) temporal trends in one's own performance (i.e., intrapersonal 
feedback alone) and (b) temporal trends in both one's own and others' performance (i.e., 
joint intrapersonal and interpersonal feedback). In regard to intrapersonal feedback alone, 
we assessed how different types of "absolute" performance information (e.g., weighted vs. 
unweighted averages of reaction times on previous trials) affected students' learning. 
Results Indicated that these manipulations had only weak effects. In regard to joint 
intrapersonal and Interpersonal f^dback, we assessed how different types of "relative" 
performance information (e.g., superiority vs.inferiority vis-a-vis others) affected students' 
learning. Here, evidence revealed that the type of feedback students received influenced 
how well they performed. It was suggested that the impact of intrapersonal and 
interpersonal feedback will be affected by the amount of practice time needed to achieve 
proftoiency. Feedback may have aiarger effectwith extendedtraining periods representative 
of nonrial classroom instruction. 
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FEEDBACK EFFECTS IN COMPUTER-BASED SKILL TRAINING 



Motivation in Computer-Based Instruction 

Our work is based on the assumption that skill acquisition in computer environments, 
as In conventional classrooms, is detennlned by several factors (cf. Carroll, 1963; Siavin, 
1986). One factor, student ajatitude, is not under teacher control, at least in the short run. 
Other factors. Including the quality of the instruction, the appropriateness of the instruction 
to the student's skills, and the amount of time the student is given to learn the material, are 
quite amenable to teacher control. Finally, the last factor, the student's motivation to work 
on instnjctional tasks, is jointly affected by both the student and the teacher. 

ft Is important to recognize that each of these factors is necessary, but not sufficient, 
for effective instruction. In attempting to conceptualize the relationships among these 
factors, it is useful to adopt a multiplicative model. Such a model has two implications. First, 
it implies that instoiction will be maximally effective when student aptitude, instructional 
quality, instructional appropriateness, time on task, and student motivation are all high. 
Second, it implies that instruction will be ineffective if even one of these factors is low. it 
should be noted that, in many circumstances, tiiese factors are not ortiiogonal. For 
example, it would not be surprising if tow instoictional quality reduced student motivation, 
or if instructional appropriateness was easier to achieve witii medium-aptitude tiian witii 
high- or low-aptitude students. 

Most researchers interested in computer-based instruction are at least implicitiy aware 
of tiie importance of tiie five factors Just mentioned. Moreover, if questioned, tiiey would 
probably acknowledge tiiat tiiese factors can, at least to some extent, compensate for and 
influence one anotiier. In spite of tills awareness, however, ti^ere is a striking imbalance in 
the amount of explicit attention tiiat has been devoted to tiie various determinants of learning 
in computer environments. Instructional quality issues, such as clarity of lesson objectives, 
organization cf infomiation, and use of examples and summaries, have received extensive 
attention. In ccntrast, motivational issues have been largely neglected. 

Many definitions of motivation in general and achievement motivation in particular have 
been proposed over tiie years. For our purposes, tiie definitions offered by Dweck and 
Elliott (1983) are appropriate. These autiiors define motivation as "contemporaneous, 
dynamic psychological factors that influence such phenomena as tiie choice, initiation, 
direction, magnitude, persistence, resumption, and quality of goal-directed (including 
cognitive) activity (p. 645)." Dweck andElllottldentifytwotypesofachiavementgoa{s(tiiose 
involving learning and tiiose involving performance) and define achievement motivation as 
"psychologtoal factors (otiier tiian ability) tiiat affect the adoption and pursuit of tiiese goals 
(p. 646)." 

One perspective on motivation and learning suggests tiiat tiie key to effortful 
perfomiance is intiinsic interest in tiie task. According to tiiis position, which is well- 
articulated by Lepper and his colleagues (e.g., Lepper, 1985; Lepper & Chabay, 1985; 
Lepper & Matone, 1985; Maione & Lepper, 1985), motivational problems can be averted 



by using tasks (such as games) that are "fun" to work on. Although such tasks may well 
prove useful in efihancing motivation for some learners In some subjects, it seems 
premature toconclude that intrinsically interesting tasks will provldeageneralsoiutionto the 
problem of motivational defteits. Some educational theorists, such as Siavin ; 1 986), declare 
that it is impossibie to mak^ alt Subjects intrinsicaliy interesting to all students, and hence 
extrinslcincentivesareessentiialtoproduceadequatelevelsof effort. Other theorist*:, such 
as tapper (1985) and Dect and Ryan (1985), point out that substantial theotetical 
disagreement exists regarding the psychological underpinnings of intrinsk: interest (e.g., 
some theories emphasize the Importance of challenge, others stress curiosity, and still 
others highlight control). This controversy suggests that the construction of intrinsically 
interesting tasks In a variety of subject domains will not be easy. Finally, it is not dear that 
intrinsteally interesting tasks, even if they could be created, would necessarily be the most 
effective way to teach many important skills. As Lepper( 1985) has suggested, the impact 
of intrinsic motivation on learning is not well understood, and there may be circumstances 
under which features of intrinsically interesting tasks actually inhibit learning. 

A second perspective on motivation and learning emphasizes the use of external 
reinforcers as a means of enhancing performance. Many programs have been developed 
in which students are rewarded for good performance and/or punished for poor 
performance. These techniques can be quite effective if students perceive clear 
contingencies between perfonnance and reinforcement and if reinforcers have high value. 
Given these constraints, it is clear that successful reinforcement programs are easier to 
implement In some environments (e.g.. military training installations) than in others (e.g., 
inner-city high schools). 

AequlsrtlQn of Component Skills in Complex Tasks 

Our research seeks to claiify the impact of motivation on learning when intrinsic interest 
islsm- Weareconcemed with the acquisition of the component skills necessary for efficient 
perfomnance on complex tasks, such as electronic troubleshooting. Moreover, we are 
concerned with skills that can be taught to individuals and small groups using computer- 
based instruction in controlled settings. A number of importanttask domains satisfy these 
criteria. For example, in reading and arithmetic, as in eiectronk: troubleshooting, many 
component skills must become automated, tf the training environment fails to produce 
active, sustained practice by the student, then this automation will not occur, and the 
component skills will be neither acquired nor incorporated into higher level skills. 

Component skills must be practiced for long periods of time in order for the leamer to 
shiftf rem controlled processing, which is stow, serial, and effortful, to automatic processing, 
w hich is fast, parallei, and fairiy effortless (Schneider, Dumais, & Shiffrin, 1984; Schneider 
&Shiffrin, 1977; Shiffrin & Schneider, 1977). For example, in learning integration formulas 
in calculus, students need to practtee the basic fonnulas many times in order to execute 
reliably a complex series of substitutions without en'or. \Notk in W. Schneider's lab on a 
variety of tasks indicates that some students quit during the initial acquisition phases 
because the resource demands are so high that the task seems impossible. Moreover, 
many students fail to exert effort on the task after modest skill levels are achieved, tt is very 
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difficult for even good students to practice a component tasl< for tiiousands of trials. 
Typically, after the first 200 trials, students' performance is accurate and moderately fast. 
The improvements per hundred additional trials may be too small to seem worth the effort. 
The absence of salient performance improvement makes it difficuitfor students to maintain 
the motivation necessaryfor sustained practice. Such practice is essential, however, when 
students shift toa higher task level. When such a shift occurs, lack of practice of component 
skills can have devastating effects. 

Varieties of Perfonnance Feedback 

Most techniques for increasing student motivation assume that certain types of 
performance feedback facilitate task-related effort, whereas other types inhibit such effort, 
tf so, then research designed to identify the characteristics of effective feedback may prove 
quite useful In improving instructional design. 

In situations where learning requires a long period of practice, the student typically 
receives feedback about his or her performance at more than one point in time (see Exhibit 
1). This information can be received either continuously (i.e., after every trial) or 
intemrtittentiy. In the intermittent case, feedback episodes can be separated by either a 
constant or a variable number of trials. Regardless of the frequency with which information 
is received, it can either reflect perfomiaice on the last trial alone or aggregated 
performanceacrosssomesetof previoustrlats. When aggregated performance is involved, 
the number of trials in the set can vary, as can the weighting function that is used to combine 
information from different trials (e.g., each trial might be weighted equally, or some trials 
might be weighted more heavily than others). 

In addition to these parameters, performance feedback can vary on other dimensions 
as well. For example, feedback can reveal either absolute perfonnance (e.g., reaction time 
in miitii^econds) or relative performance (e.g., "graded" reaction time vis-a-vis some 
stanuard). It is important to note that, compared to absolute performance, relative 
perfonnance is both more "evaluative" and less "precise." Moreover, the receipt of feedback 
can be either obligatory (in that students receive performance information whether or not 
they desire it) or voluntary (in that students can choose to receive or avoid performance 
information). In either case, students might or might not be given control over the specific 
form of feedback that they receive (e.g., continuous vs. intermittent, absolute vs. relative, 
private vs. public). Finally, of course, the temporal pattern of feedback can vary. The 
number of possible temporal patterns is immense. Potentially important aspects of such 
patterns include: the slope and intercept of tiie performance cursre; the shape of tiie cun/e 
(linear; nonlinear); and tiie degree of variability around tiie curve (botii average variability 
around tiie entire curve and specific variability around particular portions of tiie cun^e). 
Exhibit 2 Illustrates several temporal patterns tiiat might occur in students' performance 
(Ryan&Levine, 1981). 

Our discussion so far has focused on tiie student's receipt of information regarding 
temporal ti^ends in his or her own performance, which can be labeled Intrapersonal 
feedback. It Is also possible, of course, for tiie student to receive information a'^OLt temporal 



trends in both (a) his or hdr own performance and (b) another person's performance (or the 
performances of several other persons). In this case, the student gets interparsongi as 
well as In^li^rsprial feedback. 

In ordertofacilitate discussion of joint interpersonal and intrapersonalfeedback, we will 
make three simplifying assumptions. First, we will as«iume that the student receives 
feedback about another's perfomnance each time that he or she recedes feedback about 
his or her own perfomnance. if the two types of feedback are not always available, or if the 
student has the option to avoid one or both types, then a substantially more complicated 
situation can aris. We have found, for example, that '> subject whose performance is 
increasing over tinie is equally interested in seeing the performance of someone who is 
improving at a faster rate and someone who is improving at a slower rate. In contrast, a 
subject whose performance is decreasing over time is much more interested in seeing the 
performance of someone who is deteriorating at a faster rate than someone who is 
deteriorating at a slower rate (Levine& Green, 1984). The second simoiifying assumption 
that we will make is that the student receives feedback about his or her own and another's 
perfornianceatonlytwopolntsintimefTim© 1 andTime2). This assumption eliminates the 
possibility of curvilinear relationships between perfonnance and time. Finally, we will 
consider only ordinal differences between perfonnances. This means that, rather than 
dealing with the nnagnitude of the difference between Performance X and Performance Y, 
we will only be concerned with whether X is larger, smaller, or equal to Y. 

Even in the extremely simplified situation just described, a large number of relationships 
are possible (see Exhibit 3). In this table, A1 refers to Person A's performance at Time 1 , 
A2 refers to Person A's performance at Time 2, and so on for Persr ]B. Thecheckmarks 
inthe table referto the possible iotiapficsfiaal relationships betweenAI and A2andbe^ 
B1 and B2, and to the possible interpersonal relationships between A 1 and B 1 and between 
A2 and B2. Note that the intrapersonal relationships are intertemporal (that is, they cross 
' thetwotime periods), whereas the interpersonal relationships are intratemporal (that is, they 
remain within a single time period). We have left out the relationships between A 1 and B2 
and between A2 and B1 (which are both interpersonal and intertemporal), although there 
are certainly cases in which they might be interesting. Clearly, investigators who are 
interested in studying the Joint impact of interpersonal and intrapersonal feedback on 
motivation must consider a wide range of possible penormance patterns. 

To illustrate how the relationships in the table might look if they were depicted on 
graphs, we have drawn a subset of them (see Exhibit 4). This figure shows the nine 
relationships that could arise in the lower right cell of Exhibit 3 (where A1 < A2 and A1 < 
B1). 

Perfomnance Feedback and Motivation; A Brief Overview of Relevant Refiflarch 

Having made the case that perfonnance feedback on tasks involving extended practice 
is potentially quite complex, we now turn to the question of what prior research has revealed 
about the motivational consequences of such feedback. This question is both difficult and 
easy toanswer. it is difficult, because a substantial amount of research has been conducted 
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on related issues, and this work has not always yielded consistent findings. It is easy, 
because little effort has been explicKly devoted lo investigating how performance feedback 
affects motivation on extended practice tasks. Ratherthan presenting an exhaustive review 
of relevant research, we will briefly mention several lines of investigation that may suggest 
useful hypotheses for our own work (see Exhibit 5). 

A large literature de Is with the impact of "knowledge of results" (KR) on motor learning 
and performance (Adams, 1987; Salmoni, Schmidt, & Walter, 1984). Researchers have 
studied how behavior on motor tasks is affected by such KR variables as absolute and 
relative frequency, temporal locus, and precision. In seeking to explain why knowledge of 
results influences motor behavior, investigators have emphasized its motivational, as well 
as assoclational and guidance, functions (e.g., Strang. Lawrence. & Fowler, 1978). 

The effect of feedback on conceptual learning has also been studied. For example, it 
has been found that children perform better on discrimination-learning tasks when they 
receive verbal or symbolic feedback rather than tangible feedback (Barringer & Gholson, 
1979) and when they receive punishment (either alone or with reward) rather than reward 
alone (Getsle, Langer, & Glass, 1985). Both of these effects are presumably due, at least 
in part, to motivationalfactors. Other research designed to investigiate howfeedback affects 
academic performance has indicated that students do better when they take graded as 
opposed to pass-fail courses (Gold, Reilly, Silberman, & Lehr, 197 1 ), when their homework 
is checked (Austin, 1978), and when their parents are frequently informed about their 
progress (Berth, 1979). Research with adults has found tliat (a) in mathematics learning, 
the type of feedback that subjects attend to (positive vs. negative) affects performance 
(Tomarken &Kirschenbaum, 1982), (b) in military training invoKing electronics, propulsion 
engineering, and telet^'pe use, provision of detailed perfonnance feedback facilitates 
learning, especially when the feedback is given on demand and shows the incentives 
available for different performance levels (Hamovitch & Van Metre, 1981; Van Metre, 
Pennypacker, Hartman, Brett, & Ward, 1981) and (c) in multiple-cue probability learning, 
certain forms of computer graphic feedback increase learning on complex tasks (Hoffman, 
Eerie. & Siovic, 1981). 

Feedback and performance have also been investigated in organizational settings. 
Ilgen, Fisher, end Taylor (1979) have suggested thatthe effect of feedback on performance 
is mediated by the recipient's perception of the feedback, acceptance of the feedback, 
desire to respbnd to the feedback, and intended response (or goals). Each of these 
mediators, in turn, is influenced by several additional variables. For example, potentially 
Important detenninants of the recipient's perception of feedback include the timing, valence, 
and frequency of the feedback. 

The importance of goals in determining motivation and performance, and the joint 
impact of feedback and goals, have been emphasized by many authors. Mento, Stee), and 
Karren (1987) reporttheresultsof a meta-analysis that supports Locke's (1968) cont(3ntion 
that hard goals (if accepted) lead to higher performance than do easy goals (d » .58) and 
that specific hard goals lead to higher perf ormance than do general goals (d = .44). These 
reviewers aiso found that the efficacy of specific hard goals was increased by the use of 



feedback (see also Locke, Shaw, Saari, & Latham, 1981). In related work, Bandura and 
Cervone (1983) found that task motivation was highest when both performance goals and 
feedback were present. Additional research suggests that proximal and distant goals can 
have different effects on motivation (Manderlink & Harackiewicz, 1984). 

Other investigators have focused on how feedback can influence goal setting. Work on 
"level of aspiration" indicates that negative performance feedback causes individuals to 
tower their expectations for future performance, whereas positive feedback causes 
indi'vlduais to raise their expectations (e.g., Lewin, Oembo, Festinger, & Sears, 1944). 
Moreover, consistent with the idea that interpersonal as well as intrapersonal feedback is 
important, evidence indicates that Individuals' assessments of their performance quality are 
affected by how others perform (e.g., Anderson & Brandt, 1939; Chapman & Volkmann, 
1939; Dreyer, 1954; Gerard, 1961; Fontaine, 1974). 

A huge literature exists on achievement motivation, and many controversies rage 
regarding its causes and consequences. Nevertheless, most achievement motivation 
research is based on some version of expectancy-value tiieory and assumes tiiat 
performance feedback plays an important role in influencing expectancies (e.g., Ati<inson 
& Feattier. 1966; Dweck & Elliott, 1983; Featiier, 1982; Kanfer, 1987; Trope, 1986). 
Attributionai and learned helplessness models of achievement motivation, which focus on 
cognitions about success andf^iiure, give particular emphasis to tiie impact of feedback on. 
expectancies (Dweck &Qoetz, 1978;Welner, 1986). 

The utility of different types of feedback has been of interest to many motivational 
theorists. Dweck and Elliott ( 1983) and NIchoils ( 1 984) have argued ttiat Intrapersonal and 
interpcrsonatfeedback are differentially importantdependingontii^ particular achievement 
goal(leamingv8. peffomiance)tiiatisdominant. Researchers whostudyintiinsicmc^civation 
have suggested tiiat different fonns of feedback (e.g., performance-contingent vs. task- 
contingent) have different effects on subjects' interest in tiie task (Harackiewicz, Sansone, 
&Manderiink, 198S;Lepper, 1983;Sansone, 1986). And, Trope (1986) has suggested tiiat 
tiie "diagnosticity" of performance information (i.e., the degree to whteh tiie infomnation 
reveals an underlying ability) is a cnjclal determinant of achievement striving. According to 
tills analysis, a pers^^n 'q motivated to work on tasks tiiat have a high probability' of providing 
tiie kind of Pbility information he or she seeks (self-enhancing information; accurate 
information). 

We willconctudetiiisoverviewby briefly mentioning somesocial psychological research 
on how people reactto intrapersonnland interpersonal performance InfoiTnation. While tiiis 
work is typicaity not couched In motivational temis, it Is nevertiietess relevant to our present 
concerns. In regard to tiie impact of intrapersonal feedback, studies have indicated tiiat tiie 
pattern and variability of subjects' performance on a task influence tiieir liking for tiie task, 
tiioir attributions for tiieir performance, and tiieir degree of task persistence (e.g., Bryant & 
Perioff, 1986; Chaiken, 1971; Han/ey & Kelley, 1974). In regard to tiie impact of 
interpersonal feedback, studies h&ve revealed a wide range of cognitive, affective, and 
behavioral reactions. Learning tiiat one's perfonnance is superior or inferior to tiiat of 
anotiier has been found to influence attributions for past performance, expectancies for 
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future perforrtiahce, affective reactions, amount and quality of task-related behavior, and 
self-reward (Levine, 1983). Moreover, there is reason to believe that the outcomes of 
comparison may vary depending on whether two individuals are members of the same 
group or different groups and whether comparisons are made at the individual level or the 
^groMp level (Levine &Moreiand, 1986, 1987, 1989; RJisman, 1974, 1984). 

The Present Prolegt 
Reseetrch Questions 

The studies reviewed above, though relevant to our concerns, do not explicitly 
investigate the motivational consequences of intrapersonal and interpersonal performance 
feedback on cognitive tasks that require substantial practice. In order to clarify these 
consequences, it is necessary to investigate questions such as the following: 

- When the subject receives intrapersonal feedback alone 

- What is the optimal way to aggregate absolute performance 
information to enhance learning? 

-Last trial only 

- Moving average for last n trials 

- Weighted average for ail trials in block (e.g., recent 
trials weighted most heavily) 

- Unweighted average for all trials in block (all trials 
weighted equally) 

- What is the optimal way to "grade" performance information 
to enhance learning? 

- Absolute standard (e.g., 95% = A, 90% = B, etc.) 

- Stable perfomiance-based standard (criteria derived 
from S's initial perfomnance, e.g., 20% above mean > A, 
10% above mean = B, mean = C, etc.) 

- Moving performance-based standard (criteria derived 
from S's continuing perfomnance, e.g., 20?o above mean 
of last 5 trials » A, 10% above mean of last 5 trials = 

B; last trial » C, etc.) 

• Normative standard (criteria based on perfomnance of 
other Ss) 

- To what extent is learning in Trial Block n associated with: 

- Perfomnance expectation for Block n 

- Discrepancy between oerfomnance expectation for Block 
n-1 and actual perfomnance In Block n-1 
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- AttribLition(s) for performance in Block n-1 

- Satisfaction with performance in Btock n- 1 

- When the subject receives both Intrapersonai and interpersonal 
feedback 

- What factors optimize learning under individual competition? 

- Self and other similar or different in Initial skill level 

- Trial-by-trlal feedback about self and other voluntan/ 
or obligatory 

- Feedback available to self only or to both self and other 

- Anticipation or no anticipation of future competition 

- What factors optimize learning under g[SMi competition? 

• All above Issues for individual competition 

- Self and other compete as team representatives or entire 
teams compete 

- In team case, ait members of one team perform before 
ail members of other team or members from two teams . 
alternate 

- in team case, all members perform same task or different 
tasks 

- In team case, perfonnances of individual members are 
private or public within and between teams 

studies on intrapersonai Performance Feedback 

Our initial work dealt with the impact of intrapersonai perfomnance feedback. We have 
conducted several experiments designed to develop our research paradigm and provide 
preliminary infomfiation about how intrapersonai feedback affects motivation and learning. 
Qurresearch was guided by the assumptionthatthe lnfomiativeness of feedback Isacruoial 
determinant of motivatioa We believe that infonnativeness depends on the following 
factors: 

- Interpretability (use of a known metrk; for describing 
perfomnance) 

■ Degree of covariation with perfonnance 

- Sensitivity 

- Timeliness in tracking perfomiance 

• Responsiveness to "si^nif teanf changes in performance 

Study^. The purpose of thic initial study was to assess the impact of reaction-time (RT) 
feedback and a setf-evatuation "probe** question on performance in a category-search tasi<. 
The probe question was designed to measure one of the psychologteal factors that might 

8 



14 



mediate the effect of performance feedback on learning. Because we wanted to include 
probe questions in subsequent studies, we needed to determine whetiier merely answering 
such questions would affect subjects' task perf omiance. 

Fourconditions were used in whteh subjects receivedaccuracy feedback aftereach trial 
(seeExhibite). lntheMoRT/NoProbecondition(ii> 10), RT feedback was not presented, 
and subjects were not asked the probe question at the end of each block of trials. In the 
RT/No Probe condition (o s io), subjects received RTfeedback aftereach con-ect trial, but 
were not asked.the probe question. In the No RT/Probe condition (a « 12), subjects did 
not receive RT feedback, but were asked the probe question. And, In tiie RT/Probe 
condition (n » 10), subjects botii received RTfeedback and answered the probe question. 
Subjects were college students who were paid $4.00 for tiieir participation In tiie study. 

The category-search task was presented using tiie Microcomputer Experimental 
Laboretory (MEL), which runs on IBM-compatible microcomputers. Subjects were shown 
pairs of category labels, such as "article of ctotiiing" and "musteal Instalment," followed by 
two target words, such as "shirt" and "rifie." The subject's task wasto respond "yes" if either 
target word belonged In either category and to respond "no" otiienvise. The subject initially 
completed 12 practide trials (on which only accuracy feedback was presented) and tiien 
used 9-polnt scales to answer several questions about tiie task, Including his level of 
probable perfonriance, his attributions fdr future task success/failure (effort, ability, luck, 
task difficulty), andhisviewbf how enjoyable and chaliehging tiie task would be. Next, tiie 
subject completed 14 blocks of 48 tiials each. On all trials, target words were variably 
mapped onto category labels (i.e., a given target word was con'ect on some ti'lals and 
incorrect on otiiertrtals). Aftereach response, tiie subject received accuracy feedback (tiie 
word "correcT or the word "error" accompanied by tiie type of error). In addition. If he was 
In an RT condition, tiie subject also received reaction-time feedback (in milliseconds) after 
each conrect response. After each block of tn'als, subjects In tiie Probe conditions were 
asked to rate tiieir performance on a 9-polnt scale. After Blocks 7 and 14, subjects in all 
conditions answered questions tiiat were very similar to tiiose tiiey had answered after the 
practice trials. All responses were stored by tiie computer. Foltowing tiie experiment, 
subjects were told tiie purpose of tiie study and any questions were answered. The entire 
procedure took about one hour. 

Analyses wei'e conducted on subjects' response latency and response accuracy. 
Results revealed significant RT effects on botii dependent measures. Across the 1 4 blocks 
of trials, subjects who received RT feedback had shorter response latencies (when tiiey 
answered con'ectiy) (J^ s 1219 msec.) tiien did subjects who did not receive RT feedback 
(M - 1563 msec.). In contrast, subjects who received RTfeedback were less accurate (M 
» .88) tiian were subjects who did not receive RT feedback (M- -92). These data suggest 
a speed-accuracy trade-off. In addition, response latencies decreased over blocks of trials. 
The absence of otiier effects suggested, as hoped, tiiattiie Inclusion of tiie probe questions 
did not affect subjects' perfomnance on tiie category-search task. 

Several con'elational analyses were conducted to clarify tiie relationships between (a) 
subjects' latency and accuracy scores and (b) subjects' answers on tiie probe and otiier 
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questions. We attempted to determine, for example, if subjects' attributions for tlieir 
performance were related to the quality of their performance and if these relationships 
differed as af unction of the type of feedback that subjects received. These analyses did not 
yield any easily Interpretabte patterns of results. 

Study2. In contrast to Study 1 , which used feedback from only the previous trial, Study 
2 assessed the impact of feedback aggregated across trials. More specifically, we 
Investigated how ieaming in e category-search task was affected by four types of RT 
feedback (see Exhibit 7). These RT variations were (1) Last Trial Only (similar to the RT 
conditions of Study 1 - Exhibit 8), (2) Unweighted Average (based on all preceding trials in 
the block, weighted equally • Exhibit 9), (3) Weighted Average (based on all preceding trials 
in the bk>ck, with recent trials weighted more heavily than earlier trials - Exhibit 10), and (4) 
Moving Average (based on the most recent 16 trials in the block, weighted equally - Exhibit 
11). As in Study 1, subjects in all conditions received accuracy feedback after each trial. 
In addition, probe questions were presented after each block of trials in all conditions. 
Thirteen college students sensed as subjects in each of tiie four conditions. Subjects 
received $5.00, as we|i as course credit, for tiieir participation. 

We expected that tiie different types of feedback would vary in informativeness, which 
in turn would affect subjects' ieaming. Specifically, we predicted tiiat feedback 
informativenessandtherefore learning would be highestin tiie Weighted Average condition, 
next highest in the Unweighted Average condition, and lowest in tiie Moving Average and 
Last Trial Only conditions. 

The experimental task was tiie same as tiiat used in Study % witii a few exceptions. 
Rathertiian completing 12 practice trials followed by 14blocksof 48 variably-mapped (VM) 
trials, subjects initially completed 3 blocks of 60 VM practice trials, followed by 14 blocks of 
60 consistently-mapped (OM) trials (in which a given target word was always connect or 
always incon'ect). Moreover, ratiier tiian answering only one probe question after each 
block of trials, subjects answered six questions. Using 7-point scales, subjects evaluated 
their perfomnance on the cunent block, evaluated tiieir performance on tiie cunant block 
relative to tiie previous block, rated tiie infonnativeness of the performance feedback 
received on tiie cunrent block, rated tiieir effort on tiie current block, predicted their 
perfonnance on tiie next block relative to tiie cun^nt block, and rated tiieir confidence in tills 
prediction. Following tiie last block of trials, subjects answered 10 questions dealing witii 
perceived changes in tiieir accuracy and RT over blocks of trials, attributions for tiieir 
perfomnance, tiieir enjoyment of tiie task and its degree of challenge, and tiie amount of 
attention tiiat tiiey paid to accuracy and RT feet'back. Finally, subjects were asked to draw 
graphsoftiiechangeslntiielrresponsetimeandaccuracyovertiie 14 blocks of trials. The 
experimental session lasted approximately 1.5 hours. 

The results revealed several Interesting trends. Subjects Increased tiieir response 
accuracy and decreased tiieir response latency over blocks in all conditions. In addition, 
accuracy was lower in tiie Weighted Average condition (M - •84) tiian in tiie remaining three 
conditions (M * .92). Recall tiiat we predicted tiiat RT feedback would be most informative 
in tiie Weighted Average condition. If so, tiien subjects' reliance on RT feedback in tiiis 
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condition may have caused them to pay (ess attention to accuracy feedback. Subjects in 
the Weighted Average condition had relatively short response latencies (on correct trials) 
(M » 793 msec.), suggesting that they used the RT feedback that they were provided. 
Moreover, in responding to post-experimental questions, subjects in the Weighted Average 
conditiQh reported tilatth^y paid » 2.77) than did 

subjects in the three other conditions (M » 4. 18). Response latencies in the Unweighted 
AverageconditidntM » 807 msec.)wereaimostas8hortasthose In the Weighted Average 
condition. Indicating thatsubjectswereabie to deriveinfomBtionfromRTfeedba^ 
averaged over the entire block of trials. Subjects in the remaining two conditions (Moving 
Average and Last Trial Only) showed somewhat longer response latencies (Ms - 867 and 
857 msec., respectively}, 

Otiier data obtained in £^dy 2 were also of interest. For example, a positive correlation 
was obtained between subjects' actual and "grephed" response latencies across the four 
conditions (£ » .58), indicating tiiat subjects were sensitive to bk3ck-by-block trends in tiielr 
response latencies. Thecorrelation between subjects'actualandgraphedaccuracy scores 
was much weaker (t » .19). In addition, subjects in the Weighted Average condition 
reported expending sonfiewhat less effort on the task (particulariy in tiie later blocks) tiian 
did subjects in the otiier three condittoni (M * 4.20 vs. M - 5.49). In examining subjects' 
block-by-biock judgments of tiie Ihformativeness of performance feedbar:k, w«» did not find 
clear parallels between how useful RT feedback was Judged to be and how much it actually 
influenced accurecy and response latency. This suggests tiiat subjective Judgments of 
feec^ck informativeness may not always be a good indicator of tiie effectiveness of 
feedback. Finally, in extensive btock-by*block analyses exploring relationships between 
actual perfomnance, evaluations of past perfomiance, and expectations for future 
perfomnance, few reliable relationships were obtained. 

Stud^ In this and tiie folbwing experiments, we shifted from a category-search task 
to an electronic trouble shooting task. This latter task has more real-world training 
implications. In study, our goal was to adapt an existing trouble shooting task to tiie 
MEL environmentand to gatiier data regarding tiie impact of several types of RT feedback. 
In addition to Last Trial Only, Unweighted Average, and Weighted Average feedback, we 
incluted a fourtii condition in which subjects received "graded" feedback (Exhibit 12). As 
in Studies 1 and 2, subjectsreceivedaccuracyfeedback after each triaiandanswered probe 
questions after each block of trials. A witiiin-subjects design was used in which six college 
students served as subjects; tiiey were paid a total of $20.00 for five days of participation 
(one hour/day). 

The trouble shooting task was presented using MEL. Subjects were required to predict 
tiie output of four kinds of logic gates (and, nand, or, nor), which are basic components of 
digital circuits. On Day 1 , subjects f iret received a written introduction to digital electronics 
tiiat described fundamental aspects of logic gates and tnitii tables. Then, tiiey were given 
192 practice trials on logic gates; accuracy feedback was provided on each trial. In each 
of tiiree sets of 64 trials, subjetsts worked on 16 consecutive examples of each of tiie four 
gatetypes. During tiiese practice trials, subjects had access to a "help" key that showed tiie 
trutii table for tiie cunent trial. Finally, subjects were given 48 trials in which tiie four gate 
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types were intermixed and the lieip key was not available. Performance on the final 48 tr ^als 
vyas used to screen subjects for further participation. Only subjects who were correct on at 
least 75% of these triais wiire retained. 

On each of the foHowing three days (Days 2, 3, and 4), subjects received one type of 
RTfeedba(:^»LastTrialOnly,UnweightedAverags,orWeightedAverage. Theorderofthe 
three typesoffeec^ckwascoumeitalancedacrosssubjects. Oneachday, subjects were 
givenfour blocks of 144 trials; each block contained 36 (intermixed) examples of each gate 
type. Accuracy feedback consisted of either the word "con-ect" or the word "error." RT 
feedback was given in milliseconds. After each block of trials, subjects were asked to 
estimate the number of errors that they made and their typical response latency on the 
current block of tiials and to predict number of en'ors and typical response latency on'the 
next block. Fbildwing the fourth block of trials, subjects used 7-point scales to answer 10 
questions dealing with perceived changes in their accuracy and response latency over 
blocks of trials, attributions for their performance, their enjoyment of the task and its degree 
of challenge, and the amount of attentlcn that they paid to accuracy and RT feedback. 

On Days, subjects initially '''^mpletedatransfertask In which they wereasked to trouble 
shoot32min{ai...^'^circuits,eachcontainingtwosetsofthreegates. Mext, subjects received 
training on individual gates with "graded" RT feedback. Subjects were given four blocks of> 
64 trials; each block contained 16 (intemnixed) examples of each gate type. After each trial, 
subjects received accuracy feedback and a special form of Last Trial Only RT feedback. 
They were shown RT In milliseconds, nomialized by the typical perfomiance of all subjects 
on the relevant gate type, as well as a grade label (awful, poor, below average, average, 
above average, good, or excellent). The label was based on the difference between the 
subject's cunrent response latency and his average latency at the end of Day 4 (Exhibit 13). 
Following each block of trials, subjects received cumulative feedback regarding their 
average accuracy on that block, their average response latency, and their average 
response-latency grade. After they saw the cumulative feedback, subjects indicated their 
diff teuity in concentrating during the cun'ent block of trials and predicted their accuracy and 
typical response latency during the next block. Finally, subjects completed the same 10 
questions that they had answered at the end of Days 2, 3, and 4. 

A substantial amount of effort was expended in adapting the electronic trouble shooting 
task to the MEL environment. This effort was worthwhile in that subjects showed substantial 
training effects within and between Days 2, 3, and 4 and perfomned well on the transfer task 
on Day 5. On Day 2, subjects' accuracy Improved over the four blocks of trials. Mean 
accuracy (across the three RT feedback conditions) rose from 87% on Block 1 to 96% on 
Block 4. This latter accuracy level was maintained during Days 3 and 4. Regarding 
response latency, subjects* latency decreased over blocks of trials on each day of training. 
lnaddition,averageresponselatencydecreasedacrossDays2,3,and4(Ms = 1685,883, 
and 745 ms»c., consecutively). These effects occun^d re^^rdiess of the type of RT 
feedback (LastTrialOniy, Unweighted Average, Weighted Average) that subjects received. 

In regard to tiie questions that subjects answered conceming their cun-ent and future 
perfomiance, no signifteant effects due to feedback type were obtained. It is interesting, 
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however.thatregardless of thetype of feedback they received, subjects were quite accurate 
inestimatingtheircurrentaccuracy(meanactual-estimatednumberof errors ~ 1.50)and 
res^hse latency (mean actual - estimated RT » -28.67 msec.). This suggests that the 
three types of feedback were equally infonnative, whksh may help to explain why feedback 
type failed to influence subjects' perfomiance. 

The graded RT feedback on Day 5 was included to provide preliminary information 
concerning how well-trained subjects would respond to performance feedback (both trial 
and block) that was iexpllcitiy evaluative. Results indicated that subjects continued to 
maintain over 90% accuracy during Day 5, while at the same time decreasing their response 
latency across blocks. In addition, during post-experimentai inten/iews, the majority of 
subjects reported that they preferred the graded feedback to the three other types. 

Study^. In this experiment, we used a larger, between-subjects design to assess the 
impact of the four types of perf onriance feedback investigated in Study 3 (Last Trial Only, 
Unweighted Average, weighted Average, Graded Last Trial Only). Ten college students 
served as subjects in each of the four conditions. Subjects received a total of $8.00 for two 
days of participation (one hour/day). 

The expedmental task was the same as that used in Study 3, with a few exceptions. 
Subjects pariicipated in two, rather than five, sessions. On Day 1 , subjects again completed 
practice triaU^ on the four gate types separately (with access to a help key) and then 
completed a series of mixed trials (without trie help key). Only subjects who answered 
coi'^ectiy on 75% or more of the mixed practo tn'als were retained. On Day 2, subjects in 
each of the four RT feedback conditions completed four blocks of 1 44 trials and received 
accuracy and response latency infomnatlon. Feedback in the Last Trial Only, Unweighted 
Average, and WeightedAverage conditions was Identicaltothatin Study 3. Feedback in the 
Graded Last Trial Only condition differedfrom that in Study 3 in one minor way: Labels were 
based on the difference between the subject's cun^nt response latency and the average 
latency of previous subjects with a similar amount of training on the same task. After each 
block and at the end of the final block, subjects answered the same questions as in Study 
3. 

Subjects in all conditions showed significant increases in accuracy and decreases in 
response latency across blocks of trials, in addition, response latencies were somewhat 
shorter in the Last Trial Only and Graded Last Trial Only ccnditions (Ms » 1 198 and 1 156 
msec., respectivety)thanlntheUnweightedAverageandW<aightedAverage conditions (Ms 
' 1478 and 1316 msec., respectively). This pattern of /indings was different from that 
obtained in Study 2, where latencies were somewhat shorter in aggregated-feedback than 
in nonaggregated-feedback conditions, suggesting that task type may influence the impact 
of different fonns of performance feedback. 

Conclusion . The results of these studies indicated that we created an appropriate 
experimental situation for investigating the learning of component skills. We found, for 
example, that feedback affected performance even with the relatively short practice periods 
that we employed, in Study 1 , where subjects worked for less than an hour, subjects who 
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received RTfeedback had shorter response latencies than did those who did not receive this 
type of feedback. In addition, as hoped, the inclusion of probe questions did not affect 
subjects' perfonnance, indicating thatwe can usethese questions withoutconcernthatthey 
will tilas other measures. In all four studies, reasonable power-law practice functions were 
obtainedonresponse latencies, suggesting that learning was occuninginanorn^^ 
Examination of the relationship between subjects' actual response latencies and recalled 
latencies in Studies 2 and 3 revealed thatsubjects were paying attention to the RTfeedback 
tiiattheyreceived. Rnally,ttierewassomeevldencethatsubJectslikedtiiegradedfeedback 
better tiidn tiie otiier forms of feedback In Studies 3 and 4. 

incontra8ttotheoptimlsticpictureportrayedbytiieabovef}ndings,ottierdata were less 
encouraging. We did not find strong or consistent RT differences between feedback 
conditions, and few reliable relationships were obtained between cunent perfonnance and 
eitiier evaluations of past perfomiance or expectertions for future perfomnance. Our failure 
to find stronger effects may have been due to the relatively short practice periods tiiat we 
provided. As mentioned earlier, motivational problems on tasks like the ones we used often 
do not arise for hundreds or tiiousands of trials. Since our subjects only worked for an hour 
or two and were still improving at tiie end of the experiment, tiiey may have been 
unresponsive to feedback differences that would influence tiie performance of less- 
motivated learners. 

studies on tntrapersonal and Intarparsonal Performanca Feedback 

In tiiese studies, students received infomiation about temporal trends in botii tiieir own 
and otiiers' performance. Several autiiors have suggested that competition between 
individuals generally has deleterious effects on task motivation and perfomnance (e.g., 
Ames, 1984; Johnson, Maruyama, Johnson, Nelson, & Skon, 1981; Siavin, 1983). Otiiers 
have questioned tiiis conclusion, suggesting tiiat under certain circumstances competition 
can stimulate effort and leaming (e.g.. Ball, 1984; Cotton & Cook, 1982; Levine, 1983; 
Mtohaels, 1977; Seta, 1982). The goal of our research was to assess how Joint 
intrapersonal and interpersonal perfomnance feedback, whteh is essential to competition, 
affects tine acquisition of component skills tiiat require substantial practice. 



study s 

In tills experiment, we u& Jd a between-subjects design to assess tiie Joint impact of 
intrapersonal and interpersonal feedback. Fourteen college stijdents served as subjects in 
each of tiie four conditions. Subjects received a total of $8.00 for two days of participation 
(one hour/day). 

The experimental task was basically tiie same as that used in Study 4. On Day 1, 
subjects again completed practice trials on tiie four gate types separately (witii access to a 
help key) and tiien completed a block of mixed trials (witiiout tiie help key). Only subjects 
who answered con'ectiy on 75% or more of tiie mixed practtoe trials were retained. On Day 
2, subjects in each of tiie four performance feedback conditions completed eight blocks of 
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64 trials and received accuracy and response latency information. At the end of every third 
block of trials and after the last block, subjects answered the same questions as in Study 4. 

The perf onnance feedback that subjects received differed from our previous studies in 
two major ways. f=lrst, subjects were given cumulative feedbp'jk at the end of each block of 
trials. This cumulative feedback was based on a rougnly equal composite weighting of the 
subject's mean accuracy and mean response latency on the current block of trials. 
Feedback scores were computed using the formula: score » (minimum RT/mean RT) X 
mean accuracy. Minimum RT was based on pilot data, in addition, subjects received 
information about temporal trends in both their own ano others' performance on the task. 
FourtypesQfperfonriancefeecttsackwereinvestigated.uslnglheelectronlctroubieshoo 
task. In each condition, subjects were shown their composite performance score at the end 
of each block of trials, followed by a graph of their composite scores for all of the blocks 
completed up to that point. 

in the Self-Only (control) condition, subjects saw only their own perfomiance scores on 
the graph (see ExhM 14). in the three experimental conditions, subjects' graphs included 
both their own (veridical) performance scores and the (manipulated) performance scores 
of the "average pisrsdn with the same amount of experience on the task." This average 
other's perfonmance scores were either similar to, worse than, or better than the subject's 
perfonnahce scores. In the Self-Equal condition, subjects saw the scores of an average 
other who performed at approximately the same level as they did (see Exhibit 15). in the 
Self-Si>periorcondit'on,theaveragedther'sperformancewasconsistenllyand^^ 
worse than the subject's performance over blocks (see Exhibit 16). Finally, in the Self- 
Infenor condition, the average other's performance was consistently and progressively 
better than the subject's perfomriance over Irtlocks (see Exhibit 17). in each experimental 
condition, the average other's performance was based on predetemnined deviations from 
the subject's own performance. 

Subjects' responses to the post-test questions (answereo using 7-point scales) 
suggested tliat our feedback manipulation was successful. Subjects in the Self-inferior 
condition rated their overall performance as worse than that of the average other (M = 
2.00), whereas subjects in the Self-Superior condition rated their overall performance as 
better than that of the average other (M ^ 5.64). Subject in the Self-Equal and Control 
conditions rated their perfomiance as approximately equal to that of the average other (Ms 
s 4.00 and 4.21 , respectively). Across the four feedback conditions, subjects in the Self- 
Inferior condition were the least pleased with their perfomiance (M = 3.29), whereas 
subjects in the Self-Superior condition were the most pleased with their perf omnance (M = 
4.79). 

Subjects in all conditions showed increases in accuracy and decreases in response 
latency across blocks of trials. In addition, analysis of subjects' composite perfomiance 
scores showed increases across blocks of trials in ail conditions. However, the four types 
of perfonnancefeedback did not produce reliable differences in composite scores, perhaps 
because subjects worked for a relatively short period of time (two hours). 
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This experiment differed from Study 5 in several important ways. First, to assess how 
intrapersonal and interpersonal feedback affect perfonnance when motivational problems 
are more likely to be serious, we had subjects work on electronic troubleshooting tasks for 
relatively long periods of time (i.e., five hours, as compared to two hours in Study 5). 
Second, ratherthan having subjectsworkonthesameelectroniccomponents day afterday, 
we introduced new components on successive days, as would occur in a real training 
environment. Third,inordertoincreasetherealismotthetaskevenfurther,wehadst ejects 
leam complex electronic devices as well as simple logic gates. Finally, we assessed how 
subjects' level of achievement motivation affected their responses to various types of 
performance feedt)ack. 

Sixty-three undergraduates participated in five one-hour sessions, held on five 
consecutive days. Subjects were screened to eliminate engineering students and people 
familiar with electronics. Subjects were randomly assigned to the five conditions (four 
experimental and one control) and paid $22.00 for their participation. 

The experimental task Involved leaming a set of 24 electronic components drawn from 
the 7400 TTL logic series. These components are the core modules of digital circuitry and 
must be learned before an individual can do electronic trouble shooting. Subjects were 
required to predict the outputs for each of 24 components. These components Included 
eight simple logic gates (Exhibit 18) and 16 complex devices (Exhibit 19). 

Pilot research was conducted to determine the difficulty of learning each of the 24 
components. Based on this research, the components were divided into four sets of six 
components each that were approximately equal In difficulty. Each set contained two logic 
gates and four devices. The first two days of the experiment were designed to familiarize 
subjects with the task and allow them to acquire baste proficiency with a few components. 
On both of these training days, subjects worked on the same set of six components. The 
last three days of the experiment were designed to determine how various types of 
performance feedback influenced subjects' performance. On each of these experimental 
days, subjects wori<ed on a different set of six components. 

On Day 1 subjects were Initially asked to complete the Achievement subscaie of 
Jackson's(1984)PersonalityResearchFomn. This 16-itemscale,whichassessesindividual 
differences in achievement motivation, has been shown to possess high reliability and 
validity. Example of items are 1 enjoy difficult work" and "When 1 hit a snag in what I am 
doing, I don't stop until I have found a way to get around it." Next, subjects received a 
written introduction to digital electronics in order to familiarize them with the task. This 
introduction briefly described the difference between digital and analog electronic circuits, 
what it means to code information digitally, the operations that electronic components 
perfonn on binary-coded infomiation, and how to read a truth table, in addition, subjects 
were given a handout containing the truth tables for the six components that they would be 
leaming on Day 1 (Exhibit 20). 
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After they had an opportunity to study the truth tables and ask questions about them, 
subjects received additional instructions on the computer. These instrucions informed 
subjects that their job was to learn the relationships between inputs and outputs for the six 
electronic components they had just studied. They were informed that, if they had trouble 
with any component, they could press the "help" key on their keyboard and see the truth 
tableforthatcomponenton the screen. Finally, subjectsweretoidthatthey would see either 
the word "con'ect" orthe word "en'or" after each trial. After receiving all of these inc u uctions, 
subjects completed 144 practice trials, duringwhichtheyrespondedto24examples of each 
of the six components. 

At the end of the practice trials, subjects read instnjctions for the remaining test trials. 
Subjects were told that on the test trials examples of tt'ie six kinds of components would be 
mixed together and the help key would be disabled. They were instructed to respond as 
accurately and quickly as they could and were informed that after each trial they would learn 
whether they had been correct or incorrect and, on con'ect trials, how fast they had 
responded (e.g.» 1 .55 seconds). They were further infomied that at the end of each block 
of trials, they would receive a single performance score that reflected their combined 
accuracy and speed on ail the trials in the block, and they were shown a table explaining 
how accuracy and speed were combined to produce these perfomiance scores. 

Subjects then completed 12 blocks of 32 trials. Each block contained examples of all 
six components. After each trial, subjects received accuracy feedback and, if they were 
correct, response latency feedback as well. At the end of each block of trials, subjects 
received an overall performance score on that block. These scores, which could range from 
0 to 100, were calculated to weight accuracy and speed about equally. Scores were 
computed using thef omiula: (.50 ((mean accuracy - minimum accuracy)/accuracy range)) 
+ (.50 (1 - ((mean RT - minimum RT)/RT range))). Minimum accuracy, minimum RT, 
accuracy range, and RT range were based on pilot data. Perfomiance scores were plotted 
on a graph, with performance on the Y-axis and block number on the X-axis. In this way, 
subj^ saw a cumulative record of their perfomiance over the 12 blocks of trials (Exhibit 
21). After every three blocks of trials, subjects rated how pleased they were with their 
perfonDsnce on the last three blocks and estimated how well they would score on the next 
threebiocks. Afterall 12blocksoftrials,subJectsansweredaseriesof questionsabouttheir 
reactions to the task (e.g., how much attention they paid to the feedback, how well they 
perf onned, how pleased they were with their perfomiance, and why they performed as they 
had). 

The proccd'jrcw for Day 2 were the same as those for Day 1 , except that subjects did 
not complete the Jackson Personality Research Fomr? and did not receive the written 
introduction to digital electrontes. Therefore, subjects on Day 2 were given an opportunity 
to study the truth tables from Day 1 and then completed practice and test trials using the 
same six components that they had worked on before. 

The general procedures on Days 3, 4, and 5 were the same as those on Day 2, with two 
major exceptions. First, a new set of six components was introduced on each successive 
day beginning with Day 3. The presentation order for the three sets of components was 
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counterbalanced across subjects within eacli condition. Second, we introduced our 
experimental manipulation of performance feedback on Day3. This manipulationcor^Jnued 
on Days 4 and 5. 

Subjects in the Grade Band condition saw their performance graphed over a 
background of five perfonnance curves labeled Excellent, Good, Average, Below Average, 
and Poor (Exhibit 22). These five performance curves were based on data from pilot 
subjects the Average curve represents the average performance of pilot subjects, and the 
remaining curves are approximately one or two standard deviations above or below the 
average performance. Subjects in the Grade Band condition were told ttiat "along with your 
own performance scores, you will see lines indicsiting how well you are doing at any point 
in time. The lines indicate levels of performance that are excellent, good, average, below 
average, and poor." ^ 

Subjects in the Superior Other, Average Other, and Inferior Other conditions saw their 
perfomiance graphed over a background of a single perfomiance curve. In the Superior 
Other condition, the performance curve was the same as the Excellent cunfe in the Grade 
Bandconditton (Exhlblt23). Inthe Avemge Othercondition, the performancecun^e was the 
same as the Average curve in the Grade Band condition (Exhibit 24). And, in the Inferior 
Other condition, the performance cun^e was the same as the Poor curve in the Grade Band 
condition (Exhibit 25). Subjects in ail three conditions were told that "along with your own 
perfomnonce scores, you wilj see a line indicating the typical perfomnance of previous 
subjects on this task. This line therefore represents "average" performance." 

Finally, subjects in the Control (Self Only) condition did not see any infomnation about 
grades or others' perfomiance. As on Days 1 and 2, these subjects continued to see a 
graph displaying only their own perfomiance (Exhibit 26). 

In order to interpret the results of the study, it was first necessary to ascertain whether 
subjects had paidattentiontoandaccuratelyperceivedtheperfomrtancefeedback that they 
received. We therefore examined subjects' responses to the post-experimental questions 
thattheyansweredattheendofDays3,4,and5. To the question, "How much attention did 
you pay to the performance feedback graph at the end of each block?", subjects in ail five 
conditions reported a high degree of attention (M = 5.94, on a 7-point scale). This level of 
reported attention, together with the absena of any significant differences between 
conditions, suggests that subjects did indeed pay close attention to the feedback that they 
received. Of course, it is possible that subjects' responses to this question simply reflected 
confonnity to demand characteristk:s, that is, subjects' desire to have the experimenter 
believe that they followed his instructions. 

Fortunately, data on other questions suggest that subjects were in fact attentive to the 
feedback that they received. On the question, "How do you think your perfomiance 
compares with the performance of the average person on this task?", a significant condition 
effect was obtained. Subjects in the Inferior Other condition gave the most positive 
response, subjects In the Superior Other condition gave the least positive response, and 
subjects in the Average Other (and two remaining) conditions fell in between (Exhibit 27). 
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Simitar findings were obtained on the question, "Mow pleased are you witii your overall 
perfonmnce on the task?" Here, subjects in the Inferior Other condition were most pleased, 
subjects in the SupeHor Other condition were least pleased, and subjects in the Average 
Other (and^o rennaining) conditions fell in between (Exhibit 28). it should also be noted 
thattheabsence ofasignrficantDay main effectorConditionXDay interaction on responses 
to this question suggests that subjects did not become suspicious of the veracity of our 
feedback manipulation as the days progressed. 

Finally, theattrlbutionsthatsubjects nfiadefortheir performance were rather interesting. 
At the end of each day, subjects were asked to rate the importance of four detemninants of 
their porfonnance: their effort, their ability, their luck, and the difficulty of the task (Exhibit 
29). Results indicated that, across conditions, subjects generally gave greater weight to 
effortand ability (which are Internal causes of behavior) than to luck and task difficulty (which 
areextemalcauses). Moreover, whereaseffortandability were weightedaboutequalty, luck 
was weighted less heavily than task difficulty. 

We then looked at condition differences within attributions and found a couple of 
Interesting patterns. Subjects in the Grade Band and Inferior Other conditions perceived 
effort to be a somewhat more important detemiinant of their performance than did subjects 
in the remaining three conditions. This suggests that subjects in the Grade Band and inferior 
Other conditions may have worked harder on the task, or at least viewed themselves as 
working harder, than did subjects in the other conditions. And, in contrast to subjects in the 
four other conditions, those in the Superior Other condition viewed ability as a more 
important detenninant of their performance as the ddys progiessed. Since subjects in the 
Superior Other condition perfomned relatively poorly compared to the "average" other, their 
increasing tendency to attribute their perfonnance to (low) ability may have reflected an 
increasing perception of helplessness, which in turn may have reduced their task motivation. 

Let us turn now to a consideration of subjects' performance on the electronic 
components. We will focus on performance on Days 3, 4, and 5, when the various types of 
feedback were manipulated. As mentioned earlier, at the end of every block of trials, 
subjects received a score that reflected their overall performance on the 32 trials in that 
block. These scores, which could range from 0 to 100, weighted subjects' response 
accuracy and response speed about equally. On a typical day, over the 12 blocks of trials 
accuracy scores rose from about 86% to 93%, latency scores fell from about 2200 msec to 
1500msec,andperformancescoresrosefromabout31to64onthe 100-point scale. So, 
by com erting to the new metric of perfonnance scores, we not only provided subjects with 
a "summary" of both their accuracy and speed, but we also made it easy for them to detect 
rather small changes in their perfonnance. 

We adjusted subjects' performance scores on Days 3, 4, and 5 in two ways. First, we 
used perfonnance on the last block of Day 2 as a covariate to "control" for differences in 
ability. Second, we omitted subjects' perfonnance on the first block of Day 3, which 
preceded the introduction of the feedback manipulation. 
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We initialiy conducted Condition X Day analyses on both mean performance scores and 
final perfomiance scores. Both of these analyses failed to yield significant effects, perhaps 
because the large variability in subjects' responses and the small n per cell made it hard to 
detectdifferehces. Inordertodeveiopamoresensitiveindex of performance, wecomputed 
adifference scoreforeach subject on each day. This score reflected the difference between 
the subject's perfonnances on the initial and final blocks of trials (Blod^ 12 minus Block 2 
on Day 3; Block 12 minus Block 1 on Days 4 and 5). 

A Condition X Day analysis on these difference scores yielded a significant Day main 
effect and a significant Condition X Day interaction. The interaction revealed rather different 
patterns of performance change in the five conditions (Exhibit 30). As this figure shows, 
perfomiance difference scores increased substantially over days in two conditions (Grade 
Band, Inferior Other), but remained relatively stable in the three remaining conditions 
(Control, Average Other, Superior Other). As days progressed, subjects vvho received 
gradefeedbackorwhdsawtheperforrnahceofaninferioroth^rshowedlarr^erperfonr^ 
Increases from the beginning to tiie end of the experimental session. This pattern was not 
exhibited by subjects who saw only their own perfomnance, the performance of a similar 
other, or the performance of a superior other. Apparently, then, the chance to earn a higher 
grade or the chance to become even more superior toan inferior other was more motivating 
than the chance to improve in the absence of either impersonal or personal feedback, the 
chance to become superior to a simitar other, or the chance to become less inferior to a 
superior other. 

Our findings are particularly interesting in light of some of the attributional data 
presentedeariier. RecallthatsubJect^intheGradeBandandlnferiorOtiiercondltionswere 
somewhat more iK<ely to attribute their perfomiance to effort than were subjects in the 
remainingconditions.ThatsubJects in these conditions showed improveddifference scores 
over tinne may mean that effort attributions facilitated their perfomiance. Although the 
present methodology does not allow us to establish afinn causal connection between effort 
attributions and performance, such a relationship is consistent wHh tiieory. It is also 
interesting that subjects in tine Superior Otiier condition, who became increasingly likely to 
attribute their (relatively poor) perfomiance to (lew) ability, did not show improved difference 
scores over time. Perhaps tiiese ability attributions dampened subjects' motivation to 
perform. While such an explanation cannot account for the failure of difference scores to 
rise in tiie Control and Average Ottier conditions, tiiere is no a priori reason why tiie same 
psychological mechanisms must control behavior under all feedback conditions. 

In addition, we might mention tiio results of conflations between subjects' mean 
perfomiance difference scores (across Days 3, 4, and 5) and achievement motivation 
scores In tiie five conditions. Onedftiie$^3Con'etationswassignifk:ant. In tiie Grade Band 
condition, subjects who were high in achievemerrt motivation had higher perfomiance 
difference scores {t » .63). Perhaps tiie measure of achievement motivation used in tiiis 
study assesses competition against impersonal stanriards (such as grade bands) ratiier 
tiian competition against otiier people (such as inferior otiiers). If so, it might be useful to 
include a more socially-oriented measure of achievement motivation in future studies, in tiie 
hope of identifying an individual difference variable tiiat accounts for some of tiie variance 
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in subjects' performance when interpersonal competition is salient. 

Assuming that our findings prove to be reliable, one can asl< whether Grade Band and 
Inferior Other feedback are equally useful in real-world training environnisnts. We would 
tentatr/eiy suggeist thatQrade Band feedback is better suited to such training environments 
than i&infisfior jQther feedback. This conclusion is based on the supposition that grade 
bands drt lNfy^^td fncrease motivation for students at 

vvho cdnsistentiy perfbmi pooriy), whereas infeHdr other feedback is oniy effective if the 
"average" other is inferior to the student. In real-worid training environments, where all 
students wHI probabty r^ive veridical Infomiation regarding the perfomnance of "average" 
others,^hiy studerte who perfomi atibove average or superior levels will see an inferior 
average other. Students who perfomn at average, below average, or poor levels will see an 
average btherwhoiseithersimitar or superiorto themselves. And, as our data showed, this 
type of feedbapH does not increase students' task motivation. 

Conclusion . Studies 5 and 6 both manipulated intrapersonat and interpersonal 
performance feedback, but yielded rather different results. In Study 5, the various types of 
feedbSK^ dkl hdt^ p^ differences in subjects* performance, presumably 

because of the reiativety short practice period that subjects were given (two hours). In 
contrast, in Study 6, where subjects worked on the task for a longer period (five hours), 
reliable feedback :dW^^ on a measure of performance improvement 

within ieisior^^^ oureaiiierfinding$ regar;fing^e impact 

of Ifibidpifsbniil Met^ perfdrnriance feedback Is a more powerful 

determinartt of beha>^dr wheri lengthy practtoe is needed to produce proficiency. In this 
context, ft is Important to note that the differences obtained in Study 6 were based on only 
three hours of training with perfomnance standards. It is likely that in a nomnat six-week 
training course (with 240 hours of instruction), these differences would be magnified. That 
is, we assume that feedback will become a more powerful motivator as intrinsic interest 
wanes, which may take a period of time when new components continue to be introduced 
In successive sessions. 

Directions for Future Research 

Our work was stimulated by an interest in motivational aspects of computer-based skill 
training. Because perfonnance feedback lias been found to influence learning in a variety 
of noncomputer environments and because computers provide many opportunities for 
manipulating such feedback, we embarked on a series of studies designed to assess the 
motivational impact of various types of intrapersonat and interpersonal feedback. Our work 
has just scratched the surface of a very complex phenomenon, but we have learned some 
interesting things about the impact of performance feedback. 

Based on our results, we have several suggestions for using perfonnance feedback to 
enhance motivation in computer based training. As subjects spend more hours with 
interactive computer based training, motivation becomes a greater problem. Hence, 
performance feedback of the kinds we used are likely to be more effective in extended 
training procedures (e.g., greater than 10s of hours of instruction) than in special single- 
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day enrichment or remedial procedures. Our subjects seemed to like tiie graphical 
presentation of their performance over time and the comparison information that they 
receive. The block by block graphical summaries provided visual evidence of continued 
' Improvement over time. We found that subjects rsbponded bestto Grade Band or Inferior 
Other comparison data. Since the Inferior Other ounces involve deception, they are probably 
inappropriate for most training environments. We suggest that standard Grade Band 
subroutines be utilized In multiple lessons. The specific grade band levels need to be 
established for each lessonindividuaily, taking into account the experience level of students 
at each stage of instruction. 

We believe that future work should be directed toward assessing how individual and 
groupcompetittonaffectperfomianceontaskssuchasthatusedinStudy 6. The paradigm 
developed in Study 6 contains several important features of real-world training 
environmentSi Including a relatively long practice period (which could be extended even 
further), ttie introduction of new components on successive days, the use of complex 
electronic devices as well as simple logic gates, and the assessment of individual difference 
factors (e.g., achievement motivation) that are likely to influence performance, in regard to 
variables that may affect the impact of individual and grouptiompetitlon on perfomnance, we 
believe that those listed on page 8 are good candidates for initial study. 
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Performance Feedback Over Time 



• Continuous vs. intermittent 

• Constant vs. variable feedback interval (intermittent) 

• Performance on last trial or aggregated across set of 
trials 

• Number of trials in set and weighting function 
(aggregated) 

• Absolute vs. relative 

• Obligatory vs. voluntary 

• Control vs. no control over form of feedback 

• Temporal pattern 



Exhibit 1 
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INTRAPERSOI AL COMPARISON 
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Relevant Lines of Investigation 



Effect of knowledge of results (KR) on motor learning 
and performance 

Effect of feedback on conceptual learning 

Feedback and performance in organizational settings 

Goals and feedback as determinants of motivation 
and performance 

Effect of feedback on goal setting 

Achievement motivation 

0 Expectancy-value models 

o Effect of different types of feedback 

Social psychological research on reaction to 
intrapersonal feedback and joint 

intrapersonal/interpersonal feedback 
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Study 1 



Category-search Task 



RT Feedback 
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Study 2 



Category-search Task 



Last Trial Only 
Conditions J Unweighted Average 

Weighted Average 
Moving Average 
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LAST TRIAL ONLY 
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Studies 3 and 4 

P ..." . 

Electronic Trouble-shooting 




Last Trial Only 
Unweighted Average 
Weighted Average 
Graded Last Trial Only 
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ADDER 
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These are the components that you will work with today. Each 
component has its own mie for rsiating inputs to outputs. Please 
note that there are some constant njles that apply to all 
components: 

0 stande for the inactive state. 

1 stands for the active state. 
X stands for either 1 or 0. 

Some inputs are weighted more heavily than others. This 
means that the displayed input value must be multiplied 
by the weight to detemnine the actual input value. 

Por example, when input A2 equals 1, its value Is 2. 

When input A1 equals 1, its value is 1. 



SUPPER 



INPUTS II OUTPUT 

1 II 1 
0 II 0 

Output Is the same as the input. 




INVERTER 



INPUTS II OUTPUT 

i i. ? 

Output is the opposite of the input. 




JK FLIP FLOP 



CLEAR CLOCK J K || 
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X X 
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OUT 
0 
L 
1 
0 
T 
M 




When the 'clear* input is 0; then the output is 0. 

When the 'clear* input is 1, J and K are the relevant inputs. 
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RUNS DETECTOR 
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Count the number of 'active' (equal to 1) consecutive input 
states. 

Tills number conesponds to where a 1 Is placed In the output. 
The test of the ou^uts equal 0. 
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When pulse {'P') is present, the output equals the value of 
input D. 

When there Is no pulse ('P') and 'preset' and 'clear* are 

both 1, the output equals M. 
When 'preset* equals 1 and 'dear* equals 0, the output 
equals 0. 

When 'preset* equals 0, the output equals 1. 
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The outputs are the opposite of the corresponding inputs. 
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"How do you think your performance compares with the performance of 
the average person on this task?" 



Condition 


M 


Inferior Other 


5.72 


Average Other 


4.41 


Superior Other 


3.59 


Grade Band 


4.81 


Control 


4.44 
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"How pleased are you with your overall performance on the task?" 



■J 



Condition 
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Inferior Other 


5.14 


Average Other 


4.62 


Superior Other 


3.49 


Grade Band 


5.00 


Control 


4.77 
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